AXLER-ZHENG TYPE THEOREM ON A CLASS OF DOMAINS IN C" 

ZELJKO CUCKOVIC AND SONMEZ §AHUTOGLU 

fT^ I Abstract. We prove a version of Axler-Zheng's Theorem on smooth bounded pseudocon- 

J^ ' vex domains in C" on which the 9-Neumann operator is compact. 

(N 

Ph' When studying operators on spaces of holomorphic spaces, one of the important ques- 

"*^ I tions is about the compactness of operators. It has been known that on Bergman spaces, 

^1 it is the Berezin transform that plays the crucial role in characterizing compact operators. 

The well-known Axler-Zheng Theorem IIAZ98II provides the characterization of compact- 
^ . ness of finite sums of finite products of Toeplitz operators with L°° symbols on the unit 

^' 
-)— > 



open disk D. This result has been completed by Suarez [iSua07| to include operators in 



the Toeplitz algebra even on the unit ball of C". Englis |Eng99 1 prove the analog of Axler 



Zheng Theorem for Fock (the Segal-Bargmann) space and irreducible bounded symmetric 
domains in C". We note that Axler-Zheng Theorem is also true on the poly disk as the ir- 
reducibilty condition in ||Eng99[ can be removed (see ||CKL09[ pg. 232]. Raimondo [i RaiOOl 



Q>^ . found a proof of Axler-Zheng Theorem for different domains in C. Recently, Mitkovski 

^ ■ and Wick extended Axler-Zheng Theorem to the Bergman spaces AP (D" ) and with Suarez 

t^ ■ they treated weighted Bergman spaces on the unit ball in C" (see P MSW[|MW| ). 

The purpose of this paper is to provide a version of Axler-Zheng Theorem for quite 

^^ I general domains in C", namely for smooth bounded pseudoconvex domains in C". This 

setting provides a framework for the use of the methods from several complex variables, 

k> . in particular the 9-Neumann problem. However, that forces symbols to be continuous up 

H ■ to the boundary. Before, we state our main result, we will introduce notation and basic 

definitions. 

Let Q be a smooth bounded pseudoconvex domain in C". The Bergman space A^(n) is 
the closed subspace of L^(n)(with Lebesgue measure dV) consisting of holomorphic func- 
tions on n. Let P : L^(n) -^ A^(n) denote the Bergman projection. For (p G 1^(0,), the 
Toeplitz operator with symbol (p is defined as T(pf = P{(pf), for / G A^(n). Let K denote 
the Bergman kernel for Q. Then K is the unique function on O x Q with the following 
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property: /(z) = {f,K{z,.)), for every/ G A^(n) and z G O. Then 

, . i<C(H;,z) 
kziw) = , 

is called the normalized Bergman kernel. One can check that \\kz\\ = 1. Let ^{A^{C1)) 
denote the algebra of bounded linear operators on A^(n). For S G =^(A^(n)), the Berezin 
transform of S is defined as the function 

S{z) = {Skz,kz) forzG O. 

We define the Berezin transform of a function (p G L°°(Q) as (p = T,p. 

Axler-Zheng Theorem states that if S is a finite sum of finite products of Toeplitz op- 
erators on A^(D) with symbols in L°°(D), then S is compact if and only if S{z) — ^ as 
\z\ ^1". 

Our method uses standard arguments from the 9-Neumann problem. When the domain 
n is bounded pseudoconvex, as a result of Hormander's work, the complex Laplacian 
9 9 + 99 (here 9 is the Hilbert space adjoint of 9) has a bounded inverse N, known as the 
9-Neumann operator, on the square integrable (0,1) -forms on O. We refer the reader to 
llCSOlllStrlOl for more information on the 9-Neumann problem. 

Let ^{D) denote the norm closed subalgebra of ^(A^(n)) generated by {T,^ : (p G 
C(n)}. This algebra has been studied by Coburn ||Cob74| in the case of O is the open unit 



disk in C and by Axler, Conway, and McDonald IACM82I in case of O is a nonempty 



bounded domain in C. Now we state our main result. 

Theorem 1. Let Ci be a smooth bounded pseudoconvex domain in C" on which d-Neumann op- 
erator is compact. Assume that T G ^(O) and limz^.^ r(z) = for all p G bCi. Than T is 
compact. 

Remark 1. The class of domains where the 9-Neumann operator is compact is very large; 
yet it excludes certain domains with analytic disks in the boundary. A set X is said to 
have an analytic disc if there exists a nonconstant holomorphic mapping / : D — > X. The 
9-Neumann operator is compact on strongly pseudoconvex domains and more generally 
on domains with property (P) (or (P)) (see IICat84llMcN02l and HStrlOi Theorem 4.8]). For 
example, a bounded convex domain satisfies Property (P) if and only if there is no ana- 
lytic disk in its boundary (see |FS98n and jStrlOl Theorem 4.26]). Hence the next corollary 
follows immediately. 

Corollary 1. Let Cibe a smooth bounded convex domain in C" whose boundary has no analytic 
disk. Assume that T G ^(O) and limz_^p T{z) = Ofor all p G bCi. Then T is compact. 
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Remark 2. As mentioned in Remark [H Theorem [T] applies to a large class of domains in C". 
However, it excludes some simple domains such as the polydisk as the 9-Neumann oper- 
ator is not compact on the polydisk [|Sal91 | | (see also |Kra88llFS98| ). In case Q is a smooth 
bounded strongly pseudoconvex in C", Theorem[T]is a special case of |AE01l Theorem 2.3]. 



Corollary 2. Let Clbe a smooth bounded convex domain in C^ and cpj G C^{Cl) for 1 < j < m. 
Assume that (p; o / is holomorphic for all j and any holomorphic function / : D — )► bCl. Then the 
following are equivalent 

i. T = T^^- ■ ■ Tcp„^ is compact, 
ii. limz^p T{z) = Ofor all p G bCi, 
iii. the product (p\(p2 ■ ■ ■ cpm = on bCl. 

Remark 3. Corollary |2] applies to finite sums of finite products of Toeplitz operators as well. 
Let n be a smooth bounded convex domain in C^ and (pj G C(n) for 1 < j < m. Assume 
that (pj o f is holomorphic for all / and any holomorphic function / : D — > &Q and that T is a 
finite sum of finite products of Toeplitz operators T^.. Then compactness of T is equivalent 
to the continuous function (p being zero on bCl where (p is the corresponding finite sum of 
finite products of the symbols (pj. 

The techniques in this paper also give us some results about the essential norms of 
Toeplitz operators with symbols continuous up to the boundary. Let T : X — > Y be a 
bounded linear operator between two Banach spaces X and Y. Then the essential norm 
||T||e of T is defined as 

||T||g = inf{||r — S\\ : S : X — ^ Y is a compact linear operator}. 

We remind the reader that for any xp G C{Cl) its sup norm on the boundary is defined as 

Mi^ibn) = supdV'lz)! : z G fcO}. 
For n a bounded domain in C, Axler, Conway, and McDonald | |ACM82| obtained the 



essential spectrum and the essential norm of an arbitrary Toeplitz operator with a symbol 
in C(n). The following result is an extension of their result about the essential norm. 

Proposition 1. Let Clbe a bounded domain in C" and tp G C{C1). Then ||r^||e < ||'/'||L~(fen)- 
Furthermore, ifCl is smooth bounded pseudoconvex in C" such that the set of strongly pseudoconvex 
points is dense in bCl then ||T,^||e = IIV'llL'^(fon)- 

We get the following immediate corollaries due to the following facts: compactness of 
the 9-Neumann operator implies that the set of strongly pseudoconvex points is dense 
in the boundary in relative topology |§S06[ Corollary 1]; and in case of convex domains. 
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absence of analytic disks in the boundary is equivalent to compactness of the 9-Neumann 
operator ||FS98[ Theorem 1.1]. 

Corollary 3. Let O be smooth bounded pseudoconvex domain in C" and tp G C{C1) such that the 
d-Neumann operator is compact. Then ||T^||e = ||i/'||L~(&n)- 

Corollary 4. Let Q be smooth bounded convex in C" with no analytic disks in the boundary and 
xp G C(n). Then \\T^\\e = Ml'^ibCi)- 

Proofs 

Proof of Proposition^ Let us fix a > ||i/'||L~(fen) ^ 0- We will show that there exists a com- 
pact operator S such that || T,^ — S || < a.. Since bCl is compact and \x()\ < a on bCl there exists 
an open neighborhood U of bCl such that \tp\ < a on LT n O. Let us choose a smooth cut-off 
function x ^ C~(n) such that 0<;^<l,;^ = lona neighborhood of Q \ LT, and ;^ = on 
bCl. Then S = T^^p is a compact operator because x^ = on bfl. Furthermore, 

\\Txp\\e < \\Tip — S\\ < sup{|(l — xiz))ip{z)\ : z e a} < OL. 

Since a is arbitrary we get 1 1 T^ 1 1 e < 1 1 V 1 1 L~ (fen) • 

To prove the second part assume that p G bCi is a strongly pseudoconvex point and 
II r^ lie = ocq. Then for every e > there exists a compact operator K such that UTi^ — i<C|| < 
a + e. Applying the Berezin transform we get | ((T^ — K)kz, kz)\ < a + e for all z G Q. If we 
let z converge to p, compactness of K implies that {Kkz, kz) converges to zero and since p is 
strongly pseudoconvex we have 

\xp(p)\ = lim \ip(z)\ < ao + e. 

Therefore, we showed that | V'(z) | < ocq for any strongly pseudoconvex point z G bCl. Then 
continuity of xp on bfl and the assumption that the set of strongly pseudoconvex points is 
dense in the boundary imply that 1 1 V' 1 1 l~ (fon) ^ 1 1 ^i/' 1 1 e • ^ 

To prove Theorem [T] we use the following lemma as well as Proposition [U 

Lemma 1. Let Clbe a smooth bounded pseudoconvex domain in C",(p G C(n), and p G bCi be a 
strongly pseudoconvex point. Thenlim.z^p(p{z) = <p{p). 

Proof. Without loss of generality we will assume that (p is real valued. Let B{p,r) denote 
the open ball centered at p with radius r. Continuity of ^ on O implies that for every e > 
there exists c^i > such that \<p{'w) — (p{p)\ < e for zy G O n B{p,5i). Smoothness of the 
domain implies that there exists < r < c^i so that every point in B{p,r) n bfl is strongly 
pseudoconvex. Then Ti = bfl \ B{p, r) and T2 = bCi n B{p, r IT) are disjoint open subsets of 
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bd,. Then ||Bel86[ Theorem 2] (see also l|Boa87[ Theorem 2]) implies that the Bergman kernel 
K extends smoothly to Fi x T2. Since K{z, z) — > 00 as z — > p ( l|Pfl75l , see also [ |JP93[ Theorem 
6.1.7]), the normalized Bergman kernel |fczp converges uniformly to on Q \ B{p,Si) as 
z ^ p. Then there exists < ^2 < ''/2 such that z G O n B(p,^2) implies that |fcz(w)p < e 
for all w G n \ B(p, c^i). First we will estimate (p{z) from above f or z G O n B(p, (^2)- Let 
M = /j^ |(/)(H;)|dy(w) + 1. Then 

^(Z) = /" (/)(H;)|fcz(K;)|2rf\/(z(;) 

</ |(*(H;)||fcz(a;)Pdy(K;) + (d)(p)+e) / |fc2(H;)Prfy(K;) 

>/n\B(p,(5i) JnnB{p,Si) 

<e[ \(p{w)\dV{w) + {(p{p)+£) [ \kz{w)\^dV(w) 

Jn\B{p,Si) JnnB{p,3i) 

< £ I \<p{w)\dV{w) + {(p{p) + e) ( 1 - / \k^{w)\^dV{w)\ 

Jn \ Jci\B{p,Si) J 

<(p{p) + eM+\(p{p)\ I \h{w)\^dV{w) 

< (p{p) + e{M + \(p{p)\V{n)). 

In the last step we used that fact that f^\p(p^ \ \kz{w)\^dV{w) < eV(n), where V(n) de- 
notes the volume of O. Hence for z G nnB(p, ^2) we have 

(1) ^{z)-(p{p)<e{M + V{n)\cp{p)\). 
Similarly we estimate (p{z) from below as follows: 

^(z) = f (p{zv)\kz{w)\^dV{w) 

>- I \(p(w)\\kAw)\^dV(w) + ((p(p)-e) [ IkMl^dViw) 

JCi\B{p,Si) JfinB{p,Si) 

> -e / \(p{w)\dV{w) + (cpip) -e) f \k,{w)\^dV{w) 

>-ef \(p(w)\dV(w) + {(pip) - e) f 1 - I \kJw)\^dV{w)\ 

Jn V Jct\B{p,Si) J 

> (p{p) -eM- \(p{p)\ f \kz{w)\^dV{w) 
>cp{p)-e{M+\<p{p)\V{n)). 

Hence for z G O Pi B(p, (^2) we have 

(2) ^(z) - cpip) > -e{M + V{n)\cp{p)\). 



6 ZELJKO CUCKOVIC AND SONMEZ §AHUTOGLU 

Combining ^ and © we showed that for e > there exists ^2 > so that 

-eM < ^(z) - (p{p) < eM 
forz G On B(p, ^2)- Therefore, limz^p(/'(z) = (p{p). □ 

Remark 4. The Berezin transform of a function that is continuous up to the boundary is 
continuous on strongly pseudoconvex points in the boundary 

Corollary 5. Let Clbe a smooth bounded pseudoconvex domain in C" such that the set of strongly 
pseudoconvex points is dense in hCi. Assume that cp G C{Cl) and limz^p (p{z) = Ofor all strongly 
pseudoconvex points p G bCl. Then Tip is compact. 

In the proof of Theorem[T]we use Hankel operators. The Hankel operator H^ : A^{Ci) — > 
L2(n) with a symbol (p G L~(n) is defined by H^(/) = (I - P){(pf). Kohn's formula 
P = I- a* Na implies that H<f (/) = d*Nd{(pf) for/ G A^{n,) and cp G C(n). The following 
standard fact will be useful: if N is a compact operator on O then H^ is compact for all 
(p G C(n) (see UStrTOl Propositions 4.1 and 4.2]). 

Proof of Theorem^ First we will prove the theorem in case of T is a finite product of Toeplitz 
operators with symbols continuous on O. Assume that T = r(^„,T(^,„_i ' ' 'T(pi such that 
(pj G C(n) for all i and limz^p ^{'^) = for all p G fcO. Then T has a continuous extension 
on n and T = on bCl. 
Using the formula H^ H^^ = T^^i/jj — T^p-^Tip^ inductively one can show that 



'T 'T T T T I T T T /-T* 1-f 

(3) + Tcp„Jcp„,_i ■ ■ ■ Tcp^H^^Hcp^cp^ H h H^^^%„_j...<f2'^j j . 

Compactness of the 9-Neumann operator implies that Hankel operators with symbols con- 
tinuous on the closure are compact [StrlOl Proposition 4.1 and 4.2]. Therefore, we have 

where K is a compact operator. 

Let (p = (pm(pm-\ ■ ■ ■ (p\ on a. Then T = T,p + K and 

Since K is compact we have i<C = on bCi. Hence, T,^ = on bCi. However, Lemma [Himplies 
that (p = (p = Tip = on strongly pseudoconvex points. Since 9-Neumann operator is com- 
pact, | §S06[ Corollary 1] implies that the set of strongly pseudoconvex points is dense in 
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the boundary (in the relative topology). This fact together with the continuity of (p implies 
that ^ = on bCi. Hence, T^ and in turn T are compact. 

In case T is a finite sum of finite products of Toeplitz operators with symbols continuous 
on O equation ^ implies that there exists (p G C(n) and a compact operator K such that 
T = T(p + K. Then by the arguments in the previous paragraph we conclude that ^ = on 
bCl. Hence, in this case too, T is compact. 

Finally we will prove the Theorem [T] for T G 5^(0). Using ((3]) we can assume that for 
every e > there exist xpe G C{Ci) and a compact operator K^ such that \\T — T^^ + K^W < e. 
Then for z G O we have 



Tiz)-T^,{z)+Ke{z) 



= \{T{h)-T^^{h) + Ke{h),h 

< \\T-T^^ + K,\\ 

< £ 



Since we assumed that limz-^p T{z) = for all p G bCl and K^ is compact, we have 



limsup %(p) 



< e 



for every p G bCl. However, Lemma [T] implies that |V'e(p)| = limz_^p |'/'£(z)| < e for any 
strongly pseudoconvex point p G fcO. Then using continuity of ip^ on O together with the 
fact that strongly pseudoconvex points are dense in the boundary, we deduce that \xp£\ < e 
on bCl. Proposition [1] implies that there exists a compact operator Se such that || T^^ — Se\\ < 
e. Then 



\T-Se + KJ\ < \\T - T^+ KJ\ + \\T, 



tpc 



SJ\ <2e. 



Therefore, T is in the operator norm closure of subspace of compact operators in the op- 
erators. Since this subspace is closed in the operator norm topology we conclude that T is 
compact. D 

To prove Corollary |2] we will need the following result. We note that even though the 
result below was stated for symbols that are smooth up to the boundary, its proof goes 
through for symbols that are continuously differentiable on the closure of the domain. 



Theorem 2 (|C§09 Theorem 3]). Let Cl be a smooth bounded convex domain in C^ and (p G 
C^ (O). If(p o f is holomorphic for any holomorphic / : D — ^ bCl, then H^ is compact. 

Proof of Corollary^ The implication i. ^ ii. is a result of compactness of T and the fact that 
kz converges to zero weakly as z converges to fcO. 
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To prove ii. =^ iii. we use Theorem |2] to conclude that Hip. is compact for every /. This 
fact together with © implies that T = T(p + K where (p = (p\(p2 ■ ■ ■ (pn £ C{Ci) and K is a 
compact operator. Then ii. implies that (p has a continuous extension to the boundary and 
^ = on fen. On a strongly pseudoconvex point p G bCl we have 

(p{p) = lim^(z) =0. 

2— >p 



Assume that D is a nontrivial analytic disk in bCl. Then there exists a complex line L C C 



2 



such that D = L n n |C§09[ Lemma 2] (see also |lFS9l). 

Now we will show that the boundary of D is in the closure of strongly pseudoconvex 
points in bCl. Assume that there exists a point p in the boundary of D that is not in the 
closure of strongly pseudoconvex points in bd. Then there exists a nontrivial (affine) an- 
alytic disk D C bCl through p (see, for example, |Fre74l Theorem 1.1]). Since O C C^ is 



convex we conclude that D = L n O for a complex line L. However, p G L n L and since O 
is smooth L and L are perpendicular to the same normal vector at p. Therefore, L = L and 
D = D. This contradicts with the assumption that p is a boundary point of the disk D. 

The assumption that (p o f is holomorphic for any holomorphic function f : T) ^ bCl 
implies that the restriction ^|d is holomorphic on D for any analytic disk D C fcO. Then 
the maximum modulus principle applied to ^|d yields that (p = on D. Then continuity 
of ^ on n implies that (pi(p2 ■■■ (pn = (p = on bCl. 

To prove iii. =^ i., again we write T = Tcp + K where (p = (pi(p2 ■ • ■ (pn G C(n) and K 
is a compact operator. Then compactness of T follows from the fact that T^p is compact 
whenever ^ = on bCl. D 
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